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(57) Abstract 

A design interface tool (300) for designing force sensations 
for a force feedback interface device (14) comected ten » toa 
computer (12) that displays the interface tool (300). fap« from 
a user is received in the interface (300) to seteo . • We j*l tow 
sensation to be commanded by a host computer (12 g 
a force feedback interface device (14). A graphical «P^*<™ 
of the force sensation is displayed on the host computer (12) which 
provides a visual demonstration of a feel of the force sensation so 
that the user can view an effect of user input parameters on sard force 
sensation. The force sensation is output to a user marupulatable 
obfect (34) of the force feedback device (14) so that the user can 
feel the designed force sensation, where the graphical representanon 
is updated in conjunction wilh fix output of the force sensation. The 
useTcan interactively modify force sensation charactensocs and feel 
the results. 
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METHOD AND A PPARATUS FOP DESIGNING FORCE SENSATIONS 
vmrv FFFnnACK COMPUTER APPLICATIONS 



BACKGROUND OF THE INVENTION 

The present invention relates generally to interface devices for allowing humans to 
interface with computer systems, and more particularly to computer interface devices that allow 
the user to provide input to computer systems and allow computer systems to provide force 
feedback to the user. 

Users interact with computer systems for a variety of reasons. A computer system 
typically displays a visual environment to a user on a display output device. Using an interface 
device, a user can interact with the displayed environment to perform functions and tasks on the 
computer, such as playing a game, experiencing a simulation or virtual reality environment, 
using a computer aided design system, operating a graphical user interface (GUI), or otherwise 
influencing events or images depicted on the screen. Common human-computer interface 
devices used for such interaction include a joystick, mouse, trackball, stylus, tablet, pressure- 
sensitive ball, or the like, that is connected to the computer system controlling the displayed 
environment. Typically, the computer updates the environment in response to the user's 
manipulation of a user-manipulatable physical object such as a joystick handle or mouse, and 
provides visual and audio feedback to the user utilizing the display screen and audio speakers. 
The computer senses the user's manipulation of the user object through sensors provided on the 
interface device that send locative signals to the computer. For example, the computer displays 
a cursor, controlled vehicle, or other graphical object in a graphical environment, where the 
location or motion of the graphical object is responsive to the to the motion of the user object. 
The user can thus control the graphical object by moving the user object. 

In some interface devices, tactile and/or haptic feedback is also provided to the user, 
more generally known as "force feedback." These types of interface devices can provide 
physical sensations which are felt by the user manipulating a user manipulable object of the 
interface device. For example, the Force-FX joystick controller from CH Products, Inc. and 
Immersion Corporation may be connected to a computer and provides forces to a user of the 
controller. Other systems might use a force feedback mouse controller. One or more motors or 
other actuators are coupled to the joystick or other user object and are connected to the 
controlling computer system. The computer system controls forces on the joystick in 
conjunction and coordinated with displayed events and interactions by sending control signals 
or commands to the actuators. The computer system can thus convey physical force sensations 
to the user in conjunction with other supplied feedback as the user is grasping or contacting the 
joystick or other object of the interface device. For example, when the user moves the 
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ma nipulatable object and causes a displayed cursor to interact with a different displayed 
graphical object, the computer can issue a command that causes the actuator to output a force 
on the user object, conveying a feel sensation to the user. 

A problem with the prior art development of force feedback sensations in software is 
5 that the programmer of force feedback applications docs not have an intuitive sense as to how 
forces will feel when adjusted in certain ways, and thus must go to great effort to develop 
characteristics offerees that are desired for a specific application. For example, a programmer 
may wish to create a specific spring and damping force sensation between two graphical 
objects, where the force sensation has a particular stiffness, play, offset, etc. In current force 
10 feedback systems, the programmer must determine the parameters and characteristics of the 
desired force by a brute force method, by simply setting parameters, testing the force, and 
adjusting the parameters in an iterative fashion. This method is cumbersome because it is often 
not intuitive how a parameter will affect the feel of a force as it is actually output on the user 
object; the programmer often may not even be close to the desired force sensation with initial 
1 5 parameter settings. Other types of forces may not be intuitive at all, such as a spring having a 
negative stiffness, and thus force sensation designers may have a difficult time integrating these 
types of sensations into software applications. Thus, a tool is needed for assisting the 
programmer or developer in intuitively and easily setting force feedback characteristics to 
provide desired force sensations. 
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SUMMARY THE tNVF.NTION 

The present invention is directed to designing force sensations output by a force 
feedback interface device. A controlling host computer provides a design interface tool that 
allows intuitive and simple design of a variety offeree sensations. 

More particularly, a design interface for designing force sensations for use with a force 
feedback interface device is described. The force sensation design interface is displayed on a 
display device of a host computer. Input from a user is received in the interface, where the 
input selects a type of force sensation to be commanded by a host computer and output by a 
force feedback interface device. Input, such as parameters, is then received from a user which 
designs and defines physical characteristics of the selected force sensation. A graphical 
representation of the characterized force sensation is displayed on a display device of the host 
computer The graphical representation provides the user with a visual demonstration of a feel 
of the characterized force sensation such that said user can view an effect of parameters on sa.d 
force sensation. The characterized force sensation is output to a user manipulatable object of 
the force feedback interface device such that the user can feel the designed force sensation. The 
graphical representation is updated in conjunction with the force sensation being output on the 
user object, promoting further understanding of the effects of the characterization on the output 
force sensation. The user can preferably input additional changes to the characterized forces 
sensation after experiencing the feel of the sensation and feel the changed force sensation. 
Thus in an iterative process, the user can design effective force sensations through actual 
experience of those sensations. The user can preferably store the characterization or parameters 
of the designed force sensation to a storage medium that can be accessed by other programs on 
the host computer or other computers. Other programs that control force feedback can thus 
utilize the designed force sensation in applications such as games, simulations, or graphical 
interfaces. 

A wide variety of types of force sensations can be designed in the interface tool of the 
present invention. Described types include conditions, effects, and dynamics. Some force 
sensations include a simple mode of graphical representation that is more intuitive but offers 
less control over parameters that an advanced mode. In the advanced mode, a force versus user 
object motion profile is displayed, where the user may adjust parameters of the selected force 
sensation by dragging displayed control points of the profile. Represented force sensations 
include a damping condition, a spring condition, a slope condition, a texture condition, and 
periodic waves. The user can also design compound force sensations including multiple single 
force sensations. For example, a preferred graphical representation of a slope condition 
includes a hill image and a ball image, where the user moves the ball with the user object. The 
force on the ball provided by a negative spring stiffness is intuitively analogized by the visual 
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representation of the ball rolling down the hill and feeling the appropriate forces. In one 
embodiment, the force feedback interface device includes a microprocessor separate from the 
host computer system. The microprocessor receives commands from the host computer system, 
reads sensors of the interface device and reports positions of said user object to the host 
5 computer, and commands actuators of the interface device to output the force sensation on the 
user object. 

The present invention advantageously provides a simple, easy-to-use design interface 
tool for designing force feedback sensations. Given the large variety of possible force 
sensations and the often unexpected results when modifying the several parameters of force 

1 0 sensations, the design interface tool of the present invention meets the needs of force sensation 
designers that wish to create force sensations as close to their needs as possible. The graphical 
design interface of the present invention allows a force sensation programmer or developer to 
easily and intuitively design force sensations, conveniently experience the designed force 
sensations, and visually understand the effect of changes to different aspects of the force 

1 5 sensations. 

These and other advantages of the present invention will become apparent to those 
skilled in the art upon a reading of the following specification of the invention and a study of 
the several figures of the drawing. 
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FIGURE 1 is a block diagram of a system for controlling a force feedback interface 
device of the present invention; 

5 FIGURES 2a-b are top plan and side elevational views, respectively, of a first 

embodiment of a mechanism for interfacing a user manipulatable object with the force feedback 
device of Figure 1; 

FIGURE 3 is a perspective view of a second embodiment of a mechanism for 
interfacing a user manipulatable object with the force feedback device of Figure 1; 

YQ FIGURE 4 is a block diagram illustrating a preferred functionality of the force feedback 

system of Figure 1; 

FIGURE 5 is a diagram of a displayed interface of the present invention for designing 
force sensations; 

FIGURE 6 is a diagram of the interface of Figure 5 in which a design window for a 
1 5 spring condition is displayed; 

FIGURES 7a-c are diagrams of displayed graphical representations of a spring 
condition; 

FIGURE 8 is a diagram of a displayed graphical representation of a texture condition; 

FIGURES 9a and 9b are displayed graphical representations of a wall condition; 

20 FIGURE 10 is a diagram of the interface of Figure 5 in which a design window for a 

periodic effect is displayed; 

FIGURE 1 1 is a diagram of the interface of Figure 5 in which a design window for a 
periodic sweep, effect is displayed; 

FIGURES 12-13 are diagrams of the interface of Figure 5 in which a simple mode 
25 design window for a damping condition is displayed; 

FIGURES 14-15 are diagrams of the interface of Figure 5 in which an advanced mode 
design window for a damping condition is displayed; 

FIGURES 16-17 are diagrams of the interface of Figure 5 in which a simple mode 
design window for a spring condition is displayed; 
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FIGURES 18-19 are diagrams of the interface of Figure 5 in which an advanced mode 
design window for a spring condition is displayed; 

FIGURE 20 is a diagram of the interface of Figure 5 in which design windows for a 
compound force sensation are displayed; 
5 FIGURES 21-23 are diagrams of the interface of Figure 5 in which a design window for 

a slope condition is displayed; 

FIGURE 24 is a diagram of the interface of Figure 5 in which a design window for a 
texture condition is displayed; 

FIGURE 25 is a diagram of the interface of Figure 5 in which a design window for an 
1 0 angle spring condition is displayed; and 

FIGURE 26 is a diagram of the interface of Figure 5 in which a design window for a 
periodic wave is displayed. 
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pTTTATT .FD DESCRIPTIOI^Q £ XR FFERREP EMBODIMENT? 

FIGURE 1 is a block diagram illustrating a force feedback interface system 10 of the 
present invention controlled by a host computer system. Interface system 10 includes a host 
5 computer system 1 2 and an interface device 1 4. 

Host computer system 12 is preferably a personal computer, such as an IBM^ompatible 
or Macintosh personal computer, or a workstation, such as a SUN or Silicon Graphics 
workstation. For example, the host computer system can a personal computer which operates 
under the MS-DOS or Windows operating systems in conformance with an IBM PC AT 
10 standard. Alternatively, host computer system 12 can be one of a variety of home video game 
systems commonly connected to a television set, such as systems available from Nintendo, 
Sega, or Sony In other embodiments, home computer system 12 can be a television "set top 
box" or a "network computer" which can be used, for example, to provide interactive computer 
functions to users over networks. 
15 In the described embodiment, host computer system 12 implements a host application 

program with which a user 22 is interacting via peripherals and interface device 14. For 
example, the host application program can be a video game, medical simulation, scientific 
analysis program, operating system, graphical user interface, or other application program that 
utilizes force feedback. Typically, the host application provides images to be displayed on a 
20 display output device, as described below, and/or other feedback, such as auditory signals. 

Host computer system 12 preferably includes a host microprocessor 16, random access 
memory (RAM) 17, read-only memory (ROM) 19, input/output (I/O) electronics 21, a clock 18, 
a display screen 20, and an audio output device 21. Host microprocessor 16 can include a 
variety of available microprocessors from Intel, AMD, Motorola, or other manufacturers. 

25 Microprocessor 16 can be single microprocessor chip, or can include multiple primary and/or 
co-processors. Microprocessor preferably retrieves and stores instructions and other necessary 
data from RAM 17 and ROM 19, as is well known to those skilled in the art. In the described 
embodiment, host computer system 12 can receive locative data or a sensor signal via a bus 24 
from sensors of interface device 14 and other information. Microprocessor 16 can receive data 

30 from bus 24 using I/O electronics 21, and can use I/O electronics to control other penphend 
devices. Host computer system 12 can also output a "force command" to interface dev,c* 14 
via bus 24 to cause force feedback for the interface device. 

Clock 18 is a standard clock crystal or equivalent component used by host computer 
system 12 to provide timing to electrical signals used by microprocessor 16 and other 
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components of the computer system. Clock 18 is accessed by host computer system 12 in the 
force feedback control process, as described subsequently. 

Display screen 20 is coupled to host microprocessor 16 by suitable display drivers and 
can be used to display images generated by host computer system 12 or other computer 
systems Display screen 20 can be a standard display screen, CRT, flat-panel display, 3-D 
goggles, or any other visual interface. In a described embodiment, display screen 20 displays 
images of a simulation or game environment. In other embodiments, other images can be 
displayed. For example, images describing a point of view from a first-person perspective can 
be displayed as in a virtual reality simulation or game. Or, images describing a third-person 
perspective of objects, backgrounds, etc. can be displayed. A user 22 of the host computer 12 
and interface device 14 can receive visual feedback by viewing display screen 20. 

Herein computer 12 may be referred as displaying computer or graphical "objects" or 
"entities". These computer objects are not physical objects, but is a logical software unit 
collections of data and/or procedures that may be displayed as images by computer 12 on 
5 display screen 20, as is well known to those skilled in the art. For example, a cursor or a third- 
person view of a car might be considered player-controlled computer objects that can be moved 
across the screen. A displayed, simulated cockpit of an aircraft might also be considered an 
"object", or the simulated aircraft can be considered a computer-implemented "entity". 

Audio output device 21, such as speakers, is preferably coupled to host microprocessor 
20 16 via amplifiers, filters, and other circuitry well known to those skilled in the art and provides 
sound output to user 22 from the host computer 18. Other types of peripherals can also be 
coupled to host processor 16, such as storage devices (hard disk dnve, CD ROM drive, floppy 
disk drive, etc.), printers, and other input and output devices. 

An interface device 14 is coupled to host computer system 12 by a bi-directional bus 24. 

25 The bi-directional bus sends signals in either direction between host computer system 12 and 
the interface device. Herein, the term "bus" is intended to generally refer to an interface such 
as between host computer 12 and microprocessor 26 which typically includes one or more 
connecting wires, wireless connection, or other connections and that can be implemented ui a 
variety of ways. In the preferred embodiment, bus 24 is a serial interface bus providing data 

30 according to a serial communication protocol. An interface port of host computer system 12, 
such as an RS232 or Universal Serial Bus (USB) serial interface port, connects bus 24 to host 
computer system 12. Other standard serial communication protocols can also be used in the 
serial interface and bus 24, such as RS-422, MIDI, or other protocols well known to those 
skilled in the art. The USB can also source power to drive peripheral devices and may also 

35 provide timing data that is encoded along with differential data. 
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Alternatively, a parallel port of host computer system 12 can be coupled to a parallel 
bus 24 and communicate with interface device using a parallel protocol, such as SCSI or PC 
Parallel Printer Bus. Also, bus 24 can be connected directly to a data bus of host computer 
system 12 using, for example, a plug-in card and slot or other access of computer 12. Bus 24 

5 can be implemented within a network such as the Internet or LAN; or, bus 24 can be a channel 
such as the air, etc. for wireless communication. In another embodiment, an additional bus 25 
can be included to communicate between host computer system 12 and interface device 14. For 
example, bus 24 can be coupled to the standard serial port of host computer 12, while an 
additional bus 25 can be coupled to a second port of the host computer system, such as a "game 

10 port." The two buses 24 and 25 can be used simultaneously to provide a increased data 
bandwidth. 

Interface device 14 includes a local microprocessor 26, sensors 28, actuators 30, a user 
object 34, optional sensor interface 36, an optional actuator interface 38, and other optional 
input devices 39. Interface device 14 may also include additional electronic components for 

15 communicating via standard protocols on bus 24. In the preferred embodiment, multiple 
interface devices 14 can be coupled to a single host computer system 12 through bus 24 (or 
multiple buses 24) so that multiple users can simultaneously interface with the host application 
program (in a multi-player game or simulation, for example). In addition, multiple players can 
interact in the host application program with multiple interface devices 14 using networked host 

20 computers 1 2, as is well known to those skilled in the art. 

Local microprocessor 26 is coupled to bus 24 and is preferably included within the 
housing of interface device 14 to allow quick communication with other components of the 
interface device. Processor 26 is considered local to interface device 14, where "local" herein 
refers to processor 26 being a separate microprocessor from any processors in host computer 
25 system 12 "Local" also preferably refers to processor 26 being dedicated to force feedback and 
sensor I/O of interface device 14, and being closely coupled to sensors 28 and actuators 30, 
such as within the housing for interface device or in a housing coupled closely to interface 
device 14 Microprocessor 26 can be provided with software instructions to wait for commands 
or requests from computer host 16, decode the command or request, and handle/control input 
30 and output signals according to the command or request. In addition, processor 26 preferably 
operates independently of host computer 16 by reading sensor signals and calculating 
appropriate forces from those sensor signals, time signals, and stored or relayed instructions 
selected in accordance with a host command. Suitable microprocessors for use as local 
microprocessor 26 include the MC68HC711E9 by Motorola, the PIC16C74 by Microchip, and 
35 the 82930AX by Intel Corp., for example. Microprocessor 26 can include one microprocessor 
chip, or multiple processors and/or co-processor chips. In other embodiments, microprocessor 
26 can include digital signal processor (DSP) capability. 

9 
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Microprocessor 26 can receive signals from sensors 28 and provide signals to actuators 
30 of the interface device 14 in accordance with instructions provided by host computer 12 over 
bus 24 For example, in a preferred local control embodiment, host computer system 12 
provides high level supervisory commands to microprocessor 26 over bus 24, and 
microprocessor 26 manages low level force control loops to sensors and actuators in accordance 
with the high level commands and independently of the host computer 18. This operation is 
described in greater detail with respect to Figure 4. Microprocessor 26 can also receive 
commands from any other input devices 39 included on interface apparatus 14 and provides 
appropriate signals to host computer 12 to indicate that the input information has been received 
) and any information included in the input information. 

Local memory 27, such as RAM and/or ROM, is preferably coupled to microprocessor 
26 in interface device 14 to store instructions for microprocessor 26 and store temporary and 
other data In addition, a local clock 29 can be coupled to the microprocessor 26 to provide 
timing data, similar to system clock 18 of host computer 12; the timing data might be required, 
15 for example, to compute forces output by actuators 30 (e.g., forces dependent on calculated 
velocities or other time dependent factors). Timing data for microprocessor 26 can be 
alternatively retrieved from a USB signal on bus 24. 

In the preferred embodiment, sensors 28, actuators 30, and microprocessor 26, and 
other related electronic components are included in a housing for interface device 14, to which 
20 user object 34 is directly or indirectly coupled. Alternatively, microprocessor 26 and/or other 
electronic components of interface device 14 can be provided in a separate housing from user 
object 34 sensors 28, and actuators 30. Also, additional mechanical structures may be included 
in interface device 14 to provide object 34 with desired degrees of freedom. Embodiments of 
mechanisms arc described with reference to Figures 2a-b and 3 . 

Sensors 28 sense the position, motion, and/or other characteristics of a user object 34 
of the interface device 14 along one or more degrees of freedom and provide signals to 
microprocessor 26 including information representative of those characteristics. Typically, a 
sensor 28 is provided for each degree of freedom along which object 34 can be moved. 
Alternatively, a single compound sensor can be used to sense position or movement m multiple 
30 degrees of freedom. An example of sensors suitable for several embodiments described herein 
are digital optical encoders, which sense the change in position of an object about a rotational 
axis and provide digital signals indicative of the change in position. A suitable optical encoder 
is the "Softpot" from U.S. Digital of Vancouver, Washington. Linear optical encoders, 
potentiometers, optical sensors, velocity sensors, acceleration sensors, strain gauge, or other 
35 types of sensors can also be used, and either relative or absolute sensors can be provided. 
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Sensors 28 provide an electrical signal to an optional sensor interface 36, which l car , be 

«d to convert sensor signals to ^"n*'"^***"*^*^ 
ho^computersystemn. Digital optical encoders, for example, can be used. If analog sensors 

2 aTused, an analog to digital converter (ADC) can convert the analog s.gnal to a digital 
signal that is received and interpreted by microprocessor 26 and/or host computer system 12 
TaUemate embodiments, sensor signals from sensors 28 can be provided Erectly to host 
computer system 12 as shown by bus 24', bypassing microprocessor 26. 

Actuators 30 transmit forces to user object 34 of the interface device 14 in one or more 
directions along one or more degrees of freedom in response to signals recced from 
coprocessor 26. Typically, an actuator 30 is provided for each degree of freedom along 
which forces are desired to be transmitted. Actuators 30 can include two types: acfve actuators 
and passive actuators. Active actuators include linear current control motors, stepper motors 
pneumatic/hydraulic active actuators, a torquer (motor with limited angular range) a vo.ce coi, 
actuators and other types of actuators that transmit a force to move an object. For example, 
active actuators can drive a rotational shaft about an axis in a rotary degree of freedom, ordnve 
a linear shaft along a linear degree of freedom. Passive actuators can also be used for actuators 
30 Magnetic particle brakes, friction brakes, or pneumatic/hydraulic pasave actuators can be 
used in addition to or instead of a motor to generate a damping resistance or friction m a degree 
of motion. 

Actuator interface 38 can be optionally connected between actuators 30 and 
microprocessor 26. Interface 38 converts signals from microprocessor 26 into ^ 
appropriate to drive actuators 30. Interface 38 can include power amplifiers, swuches, digital to 
Zol controllers (DACs), analog to digital controllers (ADC.), and other ™^ " 
well Lwn to those skilled in the art. In alternate embodiments, interface 38 circuitry can be 
25 provided within microprocessor 26, in actuators 30, or in host computer 12. 

Other input devices 39 can optionally be included in interface device 14 and send input 
signals to microprocessor 26 or to host processor 16. Such input devices can include buttons 
£, switches, levers, or other mechanisms. For example, in embodunents where user 
34 is a joystick, other input devices can include one or more buttons provided, for example, on 
30 the joystick handle or base and used to supplement the input from the user to a game or 
simulation. The operation of such input dev.ces is well known to those skilled m the art. 

Power supply 40 can optionally be coupled to actuator interface 38 and/or actuators 30 
t0 provide elecuical power. Power supply 40 can be included within the housing of mted** 
dele 14, or be provided as a separate component. Alternatively, interface device 14 can dmw 
35 power from the USB (if used) and thus have no (or reduced) need for power supply 40. Also, 
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power from the USB can be stored and regulated by interface device 14 and thus used when 
needed to drive actuators 30. For example, power can be stored over time in a capacttor or 
battery and then immediately dissipated to provide a jolt force to the user object 34. 

Safety switch 41 is optionally included in interface device 14 to provide a mechanism to 
; allow a user to deactivate actuators 30, or require a user to activate actuators 30, for safety 
reasons In the preferred embodiment, the user must continually activate or close safety switch 
41 during operation of interface device 14 to enable the actuators 30. If, at any time, the safety 
switch is deactivated (opened), power from power supply 40 is cut to actuators 30 (or the 
actuators are otherwise disabled) as long as the safety switch is opened. For example, one 
0 embodiment of safety switch is an optical switch located on user object 34 or on a convement 
surface of a housing of interface device 14. The switch is closed when the user covers the 
optical switch with a hand or finger, so that the actuators 30 will function as long as the user 
covers the switch. Safety switch 41 can also provide a signal directly to host computer 12. 
Other types of safety switches 41 can be provided in other embodiments, such as an 
5 electrostatic contact switch, a button or trigger, a hand weight safety switch, etc. If the safety 
switch 41 is not provided, actuator interface 38 can be directly coupled to actuators 30, 

User manipulate object 34 ("user object") is a physical object, device or article mat 
may be grasped or otherwise contacted or controlled by a user and which is coupled to interface 
device 14 By "grasp", it is meant that users may releasably engage a grip portion of the object 
20 in some fashion, such as by hand, with their fingertips, or even orally in the case of 
handicapped persons. The user 22 can manipulate and move the object along provided degrees 
of freedom to interface with the host application program the user is viewing on disp ay screen 
20 Object 34 can be a joystick, mouse, trackball, stylus (e.g. at the end of a linkage), steenng 
wheel, sphere, medical instrument (laparoscope, catheter, etc.), pool cue (e.g. moving the cue 
25 through actuated rollers), hand grip, knob, button, or other article. 

FIGURE 2a is a top plan view and FIGURE 2b is a side elevational view of one 
embodiment of an interface apparatus including a mechanical apparatus 70 and user object H 
in which elec*omagnetic voice coil actuators are used to provide fore, to the use, ■ ob £ 
Such voice coil actuators are described in greater detail in co-pending patent application serurt 
30 no. 08/560,091, incorporated by reference herein. Interface apparatus 70 provides two linear 
degrees of freedom to user object 34 so that the user can translate object 12 in plan* 
woricspace along the X axis, along the Y axis, or along both axes (diagonal movement). This 
embodiment is thus preferred for use with a mouse, puck, or similar user object 34. 

Apparatus 70 includes user object 34 and a board 72 that includes voice coil actuators 
35 74a and 74b and guides 80. Object 34 is rigidly coupled to board 72, which, for example, can 



12 



WO 98/58308 



PCT/US98/12389 



10 



15 



20 



25 



be a circuit board etched with conductive materials. Board 72 is positioned m a plane 
substantially parallel to the X-Y plane and floats. Board 72 and object 34 may thus be 
Llated Jong axis X and/or axis Y, shown by arrows 78a and 78b and guided by guides 80, 
thus providing the object 34 with linear degrees of freedom. Board 72 is provided 
substantially right-angle orientation having one extended portion 82a at 90 degrees from the 
other extended portion 82b. 

Voice coil actuators 74a and 74b are positioned on board 72 such that one actuator 74a 
is provided on portion 82a and the other actuator 74b is provided on portion 82b. Wire cod 84a 
of actuator 74a is coupled to portion 82a of board 72 and includes at least two loops etched onto 
board 72, preferably as a panted circuit board trace. Terminals 86a are coupled to actuator 
dnvers so that host computer 12 or microprocessor 26 can control the direction and/or 
magnitude of the current in wire coil 84a. Voice coil actuator 74a also includes a magnet 
assembly 88a, which preferably include, four magnets 90 and is grounded, where coil 84a is 
positioned between opposing polarities of the magnet. 

The magnetic fields from magnets 90 interact with a magnetic field produced from wire 
coil 84a when current is flowed in coil 84a to produce forces. As an electric current I is flowed 
through the coil 84a via electrical connections 86a, a magnetic field is generated from the 
current and configuration of coil 84a. The magnetic field from the coil then interacts with the 
magnetic fields generated by magnets 90 to produce a force along axis Y. The magnitude or 
strength of the force is dependent on the magnitude of the current that is applied to die cod, the 
number of loops in the coil, and the magnetic field strength of the magnets. The directum of 
the force depends on the direction of the current in the coil. A voice coil actuator can be 
provided for each degree of freedom of the mechanical apparatus to which force is desired to be 
applied. 

Limits 91 or physical stops can be positioned at the edges of the board 72 to provide a 
movement limit. Voice coil actuator 74b operates similarly to actuator 74a. In yet cite 
embodiments, the translator motion of board 72 along axes X and Y can be converted ^ two 
rotary degrees of freedom, or additional degrees of freedom can be similarly proyrded wad, 
voice-coil actuation, such as an up-down or spin degrees of freedom or spin along/about a z- 



30 axis. 



35 



Voice coil actuator 74a can also be used as a sensor to sense the velocity, position, and 
or acceleration of board 72 along axis Y. Motion of coil 84a along axis Y within the magnebx 
field of magnets 90 induces a voltage across the coil 84a, and this voltage can be sensed This 
vo tage is proportional to the velocity of the coil and board 72 along axis Y. From this derived 
velocity, acceleration or position of the board 72 can be derived. In other embodiments, 
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digiul sensor, may be used to sense po^on. motion, e.c. of object 34 . low cos 
Zle dLes. For examp,e, . W -W pho,o diode sensor 92 can be used, tnc udmg a 
de.ec.or 94 positioned in a plane pamllel to me X-Y plane onto whrch a beam of 
^96 is emitted from a gmunded emitter 98. The position of the beard 72 and object 34 
5 can be determined by the location of the beam 96 on the detector. 

FIGURE 3 is a perspective view of another embodiment of a mechanical apparatus 100 
suitable for providing mechanical input and otttput to host computer system 12 Apparatus 100 
is more appropriate for a joystick or similar user object 34. Apparatus 100 tncludes gunbal 
mechanism 140, sensors 28 and actuators 30. User object 34 is shown in this embodunen. as a 
10 joystick having a grip portion 162. 

Gtabal mechanism 140 provides two rotary degrees of freedom to object 34. A gimbal 
device as shown in Figure 3 is described in greater detail in co-pending patent appbeations 
serial nos 08/374,288 and 08/400,233, both hereby incorporated by reference m thetr entuety. 
Gimbal mechanism 140 provides support for appamtu, 160 on funded surf ace 142, such as a 
table top or similar surface. Gimbal mechanism .40 is a fivemember „nkag« M mcludes a 
ground member 144, extension members 146a and 146b, and central members 148a and 148b. 
Gimbal mechanism 140 also includes capstan drive mechanisms 164. 

Ground member 144 includes a base member 166 and vertical support members 168. 
Base member 166 is coupled to grounded surfaco 142. A vortical support number 168 ■ 
coupled «o each of these outer surfaces of base member 166 such that vertical members 168 « 
in substantially 90-degme .elation with each outer. Ground member .44 , coup^o. b*^ 
surface which provides stability for mechanism 140. The members of gunbal mednunsm .40 
are mutably coupled to one another tough the use of bearings or pivots. Extenston member 
,46a is rigidly coupled to a capstan drum ,70 and is rotated about axis A as capstan drum 70 
is routed. Likewise, extension member 146b is rigidly coupled ,o the other capsun dnrml70 
and can be rotated about axis B. Centta, drive member '^—^""T?" 
member ,46a and can rotate about floating axis D, and central link member 148b ts roUUMy 
Z * to an end of extension member ,46b a, a center point P and can mute about flo^ng 
JTe Centta. drive member .48a and contra, .ink member .48b are mutably coupled <o «ch 
other a, Uae center of rotation of me gimbal mechanism, which is the point of mtenscouon P of 
« aZ B. Bearing 172 connects the two centta. members 148a and 148b together at the 
intersection point P. 

Gimbal mechanism 140 is formed as a five member closed chain such tint, each end of 
one member is coupled to the end of a another member. Gimbal mechanism 140 prov.de* two 
d 1 of fieedom to an object 34 positioned a, o, near ,0 the center point P of rn.at.on, where 
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obiec. 34 » be routed about axis A and/or B. to .Kama* embodtments, object 34 car, a.so be 
H to other degrees or freedom, such as a .toe. degme o freedom ^» 

C^a rotary "spin" degree of freedom about axis C, and these addmonal degrees of ta*. 
L be^d Lor alted. to adduion, a capsun drive mechanism .64 ea„ be coupled , 
5 Z vXi member ,68 ,o provide mechanical advantage widrou, introductng frrcnon an 
£Lh ro toe system. Sensors 28 and actuators 30 can be eoup.ed ,0 gtmbal mechamsm 40 
aft Una points between member, of the apparatus, and can be combined to toe same houstng 
of a grounded transducer 174, or 174b. A rotauonal shafl of actuator and sensor can be 
coopW to a pufiey of capstan drive mechanism 164 ,o transmit topu, and output along toe 
10 Zeiated degree of freedom. User object 34 is shown as a joystick havmg a gnp poriron ,6. 
for the user to grasp. A user can move the joystick about axes A and B. 

Other embodiment* of interface apparatuses and transducers can also be used in 
interface device .4 to provide mechanical inpu,/ou,pu, for user object 34. For exnmpfc 
Interface appararuscs which provide one or more linear degrees of freedom to user object 34 can 
15 be used. 

FIGURE 4 is a block diagram illustrating the prefixed functionality of toe feme 
feedback system 10 of Figure 1. The force feedback system provides a host control loop of 
information and a local control loop of information in a dtstributed control system. 

in the hos, control loop of information, force commands 180 are provided from toe host 
20 computer to toe microprocessor 26 and reported da* .82 is provided from toe »«~~ 
26 , toe hos. computer, to one direction of to. host confro. loop, force comma, a UO are 
output from toe boat computer .o microprocessor 26 and instruct toe mtcroproces sor » o*p 
fori having specified chamcerisucs For example, a command protocol may prov.de a ho* 
^d having a command identifier, specifying toe type offeree, and one or more — 
,< ZZ™ specifying toe characteristics of that type of force. The microprocessor decodes or 
" SZTZSZ according to local software or fitmware. The host compu,c «n a*o 
pmvide other types of hos, command, to toe microprocessor 26 to charactenze madtng d*a 
with sensors and reporting data. 

I„ the other direcnon of toe hos, conttol loop, toe local mtcroprocessor 26 receives toe 
30 bos, collda .80 and reports da,a ,S2 to toe boa, compeer. This da» 182 P« 
includes locative data (or sensor data) that describes toe posirion of toe user object 34 tn one or 
« de^ees of freedom, to some embodiments, otoer .ocadve data can also be 
ZZ ro dte ho» computer, mcluding ve.oci,y andJor acceleration data of toe user object 4 
^data describing toe states of buttons 39 and/or toe states/positions of otoer mpn, devces 39 
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and safety switch 41. The host computer uses the data 182 to update programs executed by the 
host computer, such as a graphical simulation or environment, video game, graphical user 
interface, etc. 

In the local control loop of information, actuator signals 184 are provided from the 
microprocessor 26 to actuators 30 and sensor signals 186 are provided from the sensors 28 and 
other input devices 39 to the uniprocessor 26. The actuator S1 gnals 184 are proved from 
the microprocessor 26 to the actuators 30 to command the actuators to output a force or force 
sensation The microprocessor can follow local program instructions (e.g. a "force routine ). 
Herein the term "force sensation" refers to either a single force or a sequence of forces output 
by the actuators 30 which provide a sensation to the user. For example, vibrates, textures, 
attractive forces, a single jolt, or a force "groove" are all considered force sensations, as are the 
dynamic sensations disclosed herein. 

In the other direction of the local control loop, the sensors 28 (and other input 
devices/safety switch) provide sensor signals 186 to the microprocessor 26 indicating a position 
(or other information) of the user object in degrees of freedom. The microprocessor may use 
the sensor signals in the local determination offerees to be output on the user object, as weH as 
reporting locative data in data 182 derived from the sensor signals to the host computer that 
represents the position (or other characteristics) of the user object 34, as explained above. The 
da\a 182 reported to the host computer by the microprocessor 26 typically includes a duect 
representation of the position (or motion) of the user manipulatable object 34. The host 
computer updates an application program according to the newly-received position. 

In a different, host-controlled embodiment that utilizes microprocessor 26, host 
computer 12 can provide low-level force commands over bus 24, which microprocessor 26 
directly transmits to the actuators. In yet another alternate embodiment, no local 
microprocessor 26 is included in interface system 10, and host computer 12 directly controls 
and processes all signals to and from the interface device 14, e.g. the host computer directly 
controls the forces output by actuators 30 and directly receives sensor signals 186 from sensors 
28 and input devices 39. 
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Because force feedback devices can produce such a wide variety of feel sensations, each 
with its own unique parameters, constraints, and implementation issues, the overall spectrum of 
force sensations has been divided herein into subsets. Herein, three classes of feel sensations 
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are d.scussed- spaflal conditions ("conditions"), temped AO C«ffeoU" or "waves") and 
(..dynamics"). Conditions are force sensations to arc a toncon of user 
JoZ =" orTscnsations to* arc a predefined proffle p.ayed back over time, an 
Til Tfol sedations toa. are based on - in.er.tive dynamic mode, of mo„o„ and 

time. 

Conditions describe the basic physical properties of an interface device based on spatial 
m „fion of .he interface. For example, a joystick device has basic properties such as the 
stiffness damping, inertia, and friction in the joystick handle. These element continuous 
S. nndUng feel of hand, motion dating genera! mansion. Cond .ions can £ 
be barriers or obstructions ("walls") that restrict spatial manipulate of the stick, and can also 
be textures. Conditions are very compelling physical sensations because they generate forces* 
a function of the spatial motion of the interface device as caused by toe user, to most 
aprons, conditions are used to tune the genera, fee, of the device has* upon pr£- 
paLeters. For exampfe, when flying an F-,6 fighter in a game, a ^<-*"-££ 
made to fee, very stiffand heavy. When flying an old Spitfire, ajoystick handle 
To fee, ,oose and light When toe craft is damaged by an enemy fire, toe joystick handle mrgh, 
be made to feel sticky with a scratchy texture. 

Conditions are typically no. associated with discrete sudden events during game play or 
apphcation use, b« are rafter background conditions or background phystca, parties ^ 
™Kcario„ events, hence toe name "conditions." A condition rs usually an cnvuonmcotal .k* 
Z up and xperienced over an extended period. Conditions may create force sections 
Z " a Lotion of user object position, user vetocrty, and/or user object accelem^ 
Preferred standard rypes of conditions are springs, dampers, inertia, fhctton, texture, an £fc 
A spring force is a restoring force that feels lite stretching or compressing . spnng. A damper 
force is a drag resistimco toa, feels Ukc moving torough a viscous liquid. An mcrria foreo 
sensation feds as if toe user is moving a heavy mass. A Motion force sensauon is a contact o 

fee* L drugging a stick over a gating. A wall is an obsrtuction havang a specficd .ocaaon 
that feels like a hard stop or a soft cushion. 

Commanding conditions of toe above types involves specifying toe condition type and 
defining toe unique physic*, properties associated wito toa. type. Pro*. 
feel of toe force sensation by adjusting toe location of toe spring ongtn by ass,gning <rt*» 
« axes toe spring is applied lo. by limiting toe maximum force output of toe spnng r^arton 
etc Anotii parameter is a bigger parameter, which defines when to create toe condttton 
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nation, in ft. simples, case, *. condition migh. be crcaud (nigged, d^ly<*onthe call 
bos. command. In ft. more advanced case ft. condmon sensaoon bemg defined rmgM 
Jgenexa.ed (uiggered, upon a loci even, such as .he press of a bunon. By definmg ftcse 
ZZLn a wide variety of feel, can be creaud. By combining motople spnngs, even more 
, ™sXs can be defined. By con.bin.ng one rype of condifion vrift ofter cond.rions 
such as textures and friction, the diversity grows further. 

Effects are force sensations that are closely correlated with discrete temporal events 
during game play. For example, a shuttlecraft is blasted by an alien laser, the user feels a 
,0 physical blast that is synchronized with graphics and sound that also represent the event Th 
Lit will likely have a predefined duration and possible have other parameters that desenbe the 
physical feel of the event. While discrete, effects can have a substantial duration - for example, 
tf a small motor boat is caught in the wake of a huge tanker, the bobbing sensaUon may be an 
effect that lasts over an extended period and may vary over time. Effeets are best thought of as 
15 predefined Actions of time such as vibrations and jolts that can be "overlaid' on top of the 
background conditions described above as foreground sensaUon, In other words, effects are 
forces that are defined and "played back" over time when called. 

Effects fall into two classes as described herein: a) Force Signals and b) Force Profiles. 
20 A Force Signal is an effect that is defined based on a mathematical relationship between tome 
and time This mathematical relationship is defined using waveform convenuons. For 
example, a Force Signal might be define* as a fore that varies with time based on a ~e 
of a given frequency and magnitude to create a vibration sensation. A Force Frofite ^ 
that fs defined based on a sueam of digitized data. This is simply a hst of force sample *at arc 
stored and P laye4 back over time. Using Force Signals, a complex sensaUon can be denned 
Id on sLple parameters such as Sine-Wave, 50 Hz, 50'/. magnitude. An advantage o 
Force Profiles is that they allow for more general shapes of forces, but require a Significant 
amount of data to be transferred to and stored at the interface device 14. A convenient way of 
defining force effects is by common wave parameters such as source, magmtude, penod, 

offset, and phase. Once a waveform is defined, its shape can be 
envelope whose shape is defined by further parameters such as Impulse Level 
Fade Level and Fade Time. Further parameters can specify direction tn vector ^ * 
freedom, and triggers (buttons). Furthermore, a single complex effect can be specified as 
sequential combination of multiple simpler effects. 

Three basic types of effects are periodic, constant force (vector force), and ramp The 
penod.c type of effect is the basic effect described above, in which a signal source such as a 
sine wav^angle wave, square wave, etc., has a frequency and amplitude and may be shaped 
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for a specific application. A vibration is the most common type of periodic force. A constant 
force is simply a constant magnitude output over time, but also may be shaped using the 
envelope parameters discussed above to achieve a waveform that is shaped hke the envelope. 
A ramp is simply a rising force magnitude followed by a falling force magnitude, and can be 
5 defined as a single half cycle of a triangle wave or other waveform. Other types, such as 
periodic sweep, vector force, pop, and smart pop, can also be defined. 

Dynamic force sensations provide interactive force sensations based on real-time 
dynamic simulations of physical systems. Dynamic sensations involve real-time physical 

10 interactions based on 1) user motion as well as 2) a physical system wherein user motion 
during the interaction affects the behavior of the physical system. For example, if the user 
wades through swamp-muck in a violent manner that stirs up undulations in the fluid, the user's 
rash motions will increase the difficulty of travel because the undulations in the fluid will 
worsen as the user struggles. But, if the user wades through the swamp-muck in a dexterous 

15 manner that absorbs the undulations in the fluid, the user will have an easier time passing 
through the muck. This example, like all interactions with physical systems, demonstrates that 
how the user influences the system during the event will effect how the event feels. 

High level dynamic sensation commands allow the host computer to coordinate the feel 
20 and execution of the dynamic sensations with gaming or other application program interactions. 
Each dynamic sensation sets up a physical sensation within the local processing routine of the 
interface device. Parameters defined by the programmer can tune the dynamic sensation for 
specific application events. Basic types of dynamic sensations include Dynamic Control Law, 
Dynamic Recoil, Dynamic Impact, Dynamic Liquid. Dynamic Inertia, Dynamic Center Dnft, 

25 Dynamic Sling and Dynamic Paddle. Preferably, each of these sensations is based on a basic 
physical system defined in Dynamic Control Law including a dynamic mass that is connected 
to the user object 34 by a simulated spring and a simulated damper. When the user object 34 
moves, the simulated mass moves because the spring and the damper link the two systems 
"physically" Depending upon how the mass, the spring, and the damper parameters are 

30 defined, the mass might jiggle, jerk, or sluggishly lag behind the user object. Also, there are 
initial conditions that can be defined to help tune the feel sensation, and an ambient damping 
parameter that defines the simulated medium that the mass is moving in. The user feels the 
effects of the physical system and may influence the physical system dynamically. These 
parameters can be varied to provide the variety of dynamic sensations. 

35 

FIGURE 5 illustrates a display device 20 displaying an interactive graphical toolset 
interface 300 of the present invention that enables developers and programmers of force 
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feedback ("users" of the interface) to design and implement force sensations rapidly and 

,.,•.„♦ allows conditions, effects ("waves"), and dynamics to 
efficiently. The graphical environment allows conoiuons, v 

be defin* through intuitive graphical metaphors that convey the physical meaning of each 
parameter involved. As the parameters are manipulated, sensations can be felt » real-time, 

5 allowing for an iterative design process that fine-tunes the feel to the designer's exact need. 
Once the appropriate sensation is achieved, the interface can save the parameters as a resource 
and automatically generate optimized code in a desired format that can be used directly within 
an application program. Thus, interface 300 handles most of the force feedback development 
process from force sensation design to coding. With these tools, force feedback programming 

1 0 becomes a fast and simple process. 

The challenge of programming for force feedback is not the act of coding. Force 
models to provide force sensations are available, and, once the desired force sensation is known 
and characterized, it is straightforward to implement the force sensation using software 
15 instructions. However, the act of designing force sensations to provide a desired feel that 
appropriately match gaming or other application events is not so straightforward. Designing 
force sensations and a particular feel requires a creative and interactive process where 
parameters are defined, their effect experienced, and the parameters are modified until fee 
sensations are at the desired characterization. For example, when designing conditions, this 
20 interactive process might involve setting the stiffness of springs, sizing the deadband, 
manipulating the offset, and tuning the saturation values. When designing effects, dus might 
involve selecting a wave source (sine, square, triangle, etc.), setting the magnitude, frequency, 
and duration of the signal and then tuning the envelope parameters. For a dynamic sensation, 
this might involve setting the dynamic mass, and then tuning resonance and decay parameters. 
25 With so many parameters to choose from, each applicable to a different type offeree sensation, 
there needs to be a fast, simple, and interactive means for sensation design. To solve this need, 
the graphical interface 300 of the present invention allows a user to rapidly set physical 
parameters and feel sensations, after which the interface automatically generates the appropriate 
code for use in a host computer application program. 

Interface 300 enables interactive real-time sensation design of conditions, effects, and 
dynamics, where parameters can be denned and experienced through a rapid iterative process. 
Thus, it is preferred that a force feedback interface device 14 be connected to the computer 
implementing interface 300 and be operative to output commanded force sensations. Intuitive 
graphical metaphors that enhance a programmer's understanding of the physical parameters 
related to each sensation type are provided in interface 300, thereby speeding ^ 
design process. File-management tools are also preferably provided in interface 300 so that 
designed force sensations can be saved, copied, modified, and combined, thereby allowing a 
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user to establish a library of force sensations. Once sensations are defined, the interface 300 
preferably stores the parameters as "resources" which can be used by an applicauon program. 
For example, by linking a force sensation resource into an application program, the resources 
can be converted into optimized Direct-X code for use in an application in the Windows 

5 environment. Other code formats or languages can be provided in other embodiments. 
Interface 300 can be implemented by program instructions or code stored on a computer 
readable medium, where the computer readable medium can be either a portable or immobile 
item and may be semiconductor or other memory of the executing computer (such as computer 
12), magnetic hard disk or tape, portable disk, optical media such as CD-ROM, PCMCIA card, 

10 or other medium. 

As shown in Figure 5, the interface 300 has three primary work areas: the sensation 
pallet 302, the button trigger pallet 304, and the design space 306. Force sensations are created 
in the design space 306 and can be saved and loaded into that space using standard file handling 
15 features. 

To create a new force sensation, a sensation type is chosen from the sensation pallet 
302 Pallet 302 is shown in an expandable tree format. The root of the tree includes the three 
classes 310 of force feedback sensations described herein, conditions, waves (effects), and 
20 dynamics. Preferably, users can also define their own headings; for example, a 'Tavontes 
group can be added, where force sensations with desirable previously-designed parameters are 
stored. 

In interface 300, the conditions, waves, and dynamics classes are shown in expanded 
25 view These classes may also be "compressed" so as to only display the class heading if 
desired When a class is displayed in expanded view, the interface 300 displays a listing of all 
the sensation types that are supported by the hardware connected to the host computer 12 for 
that class. For example, when programming for more recent or expensive hardware supporting 
a large number of force sensation types, a list including many or all available sensation types is 
30 displayed. When programming for older or less expensive interface device hardware that may 
not implement all the sensations, some sensation types can be omitted or unavailable to be 
selected in the expanded view. Preferably, interface 300 can determine exactly what force 
sensations are supported by a given interface device 14 connected to the host computer by using 
an effect enumeration process, i.e., the host computer can request information from the 
35 interface device, such as a version number, date of manufacture, list of implemented features, 
etc. 
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Once a sensation type is chosen from the sensation pallet 302, the sensation type is 
added to the design space 306. For example, in Figure 5, an icon 308 for the selected force 
sensation "Damper" is displayed within the design space 306 window. Icon 308 can now be 
selected/opened by the user in order to set the parameters for the given sensation type using 
graphical development tools (described below). Multiple icons can similarly be dragged to the 
design space to create a more complex force sensation. Once the parameters are specified for 
the given sensation, the sensation can be saved as a resource file. Using this process, a user can 
create a diverse library of feel sensations as resource files. Also, predefined libraries of sample 
resources from third party sources might also be available. 

Options displayed in the trigger button pallet 304 can also be selected by the user. 
Trigger pallet 304 is' used for testing force sensations that are going to be defined as button 
reflexes. For example, a force sensation might be designed as a combination of a square wave 
and a sine wave that triggers when Button #2 of the interface device is pressed. The square 
wave would be created by choosing the periodic type 312 from the sensation pallet 302 and 
defining parameters appropriate for the square wave. A sine wave would then be created by 
choosing another periodic type 312 from the sensation pallet 302 and defining the parameters 
appropriate for the sine wave. At this point, two periodic icons 308 would be displayed in the 
design space window 306. To test the trigger, the user can just drag and drop these icons 308 
into the Button 2 icon 314. Button 2 on the interface device 14 has thus been designed to 
trigger the reflex sensation when pressed. This process is fast, simple, and versatile. When the 
user achieves a sensation exactly as desired, the sensation can be saved as a resource file and 
optimized software code for use in the application program is generated. The Button 2 
selection might be provided in other ways in different embodiments. For example, the user 
might select or highlight die designed force icons in design space 306 and then select the 
Button 2 icon in pallet 304 to indicate that the highlighted forces will be triggered by Button 2. 

FIGURE 6 illustrates interface 300 where a force sensation is characterized in the 
design space 306. When an icon 308 in design space 306 is selected by the user, the icon 308 
expands into a force sensation window and graphical environment for setting and testing the 
physical parameters associated with the selected sensation. For example, in Figure 6, a spring 
sensation type 320 has been selected from the condition list 322 and provided as icon 324 in 
the design space 306. A spring window 326 is displayed in design space 306 when icon 324 is 
selected. Within spring window 326 are fields 328 characterizing the force, including the axis 
330 (and/or direction, degree of freedom, etc.) in which the force is to be applied, the gain 332 
(or magnitude) of the force, and the parameters 334 associated with the force sensation. For 
example, for the spring sensation, the positive stiffness ("coefficient"), negative stiffness 
("coefficient"), positive saturation, negative saturation, offset, and deadband of the spring 
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sensation are displayed as parameters. The user can input desired data into the fields 328 to 
characterize the force. For example, the user has specified that the force is to be appbed along 
the x-axis (in both directions, since no single direction is specified, has specified a gam of 100, 
and has specified saturation values of 10,000 in positive and negative directions. The user can 
also preferably specify all or some of the parameters in graphical fashion by adjusting the sue 
or shape of the envelope, the height or frequency of the waveform, the width of the deadband or 
springs, the location of a wall on an ax,s, etc. by using a cursor or other controlled graphical 
object. 

As the user inputs values into fields 328, the resulting additions and changes to the force 
sensation arc displavcd in an intuitive graphical format in the force sensation window. For 
example in the spring sensation window 326, graphical representation 336 is displayed. 
Representation 336 includes an image 338 of the user object 34 (shown as a joystick, but which 
also can be shown as other types of user objects), an image 340 of ground, an image 342 of a 
spring on the right of the joystick 34, and an image 344 of a spring on the left of the joystick 
34. Representation 336 models a single axis or degree of freedom of the interface device. 

Representation 336 represents a physical, graphical model with which the user can 
visually understand the functioning of the force sensation. The user object image 338 is 
displayed preferably having a shape similar to the actual user object of the desired interface 
device (a joystick in this example). Along the displayed axis, in both directions, there are . 
spring images 342 and 344 as denned by a positive stiffness parameter (k) and a negate 
stiffness parameter (k). Graphically, the large stiffness of the spring to the right (coefficient of 
80) is represented as a larger spring image 342. The origin of the spring condition is shown at a 
25 center position 346, since the offset parameter 348 is zero. If the offset has a positive or 
negative magnitude, the origin would be displayed accordingly toward the left or right. The 
deadband region is shown graphically as the gap between the user object image 338 and the 
spring images 342 and 344. 

In the preferred embodiment, the graphical representation further helps the user 
visualize the designed force sensation by being updated in real time in accordance with the 
movement of the user object 34 of the connected interface device 14. User 
will move in a direction corresponding to the movement of user object 34 as caused by fee user. 
The user object is free to be moved in either the positive or negative direction along the given 
axis and encounter either a positive or negative stiffness from the spring sensation. Thus if the 
user object is freely moved to the left from origin 346, the joystick image 338 is moved left in 
the deadband region, and when the user object 34 encounters the spring resistance, toe joystick 
image 338 is displayed contacting the spring image 344. If there is no deadband defined, the 
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spring images 342 and 344 are displayed as contacting the joystick image 338 at the center 
position. The edge stop images 350 define the limits to the degree of freedom; for example, 
when the user object 34 is moved to a physical limit of the interface device along an axis, the 
joystick image 338 is displayed as contacting an appropriate edge stop image 350. 

5 

FIGURES 7a-7c illustrate graphical representation 336 as the user object 34 is moved 
by the user. In Figure 7a, the user moves the user object 34 and image 338 in a positive 
direction along an axis as shown by arrow 354. No force resistance is felt by the user, since the 
user object is in the deadband region. This is represented by displaying joystick image 338 

10 having no contact with other objects. In Figure 7b, the user object 34 encounters spring 
stiffness in the positive direction and begins to compress the spring. As shown by the graphical 
representation 336, the joystick image 338 has contacted right spring image 342 and the spring 
image 342 is shown slightly compressed. In Figure 7c, the user object continues to move 
against the spring force, as accordingly displayed as spring 342 compression in representation 

15 336. Once the positive spring stiffness is encountered, the resistance force increases linearly 
with compression of the spring (as is true of a real spring). The amount of compression felt by 
the user is correlated with the amount of compression shown by spring image 342. If the 
programmer has defined a saturation value for force opposing movement in the positive 
direction, the force output would cease increasing with compression once the saturation limit in 

20 the positive direction was exceeded. The saturation can also be shown graphically, for example 
by displaying the applicable spring image in a different color (such as red), or by displaying a 
message or indicator on the screen. 

Referring to Figure 6, once the user has tested the input parameters and settings, he or 
she may change any of the existing information or add new information by inputting data into 
fields 328. Any such changes will instantly be displayed in window 326. For example, if the 
user changes the coefficient (stiffness) of the spring on the right, the spring image 342 will 
immediately be changed in size to correlate with the new value. The user thus gains an 
intuitive sense of how the sensation will feel by simply viewing the representation 336. The 
user can then determine how the sensation will feel with more accuracy (fine tuning) by moving 
the user objected feeling the sensation. Thus, the graphical representation 336 as displayed 
clearly demonstrates to the user the various effects of parameters on the force sensation and 
additionally allows the user to experience the forces coordinated with the graphical 
representation. 

FIGURE 8 illustrates another graphical representation 360 that can be displayed in 
interface 300 for a spatial texture condition. Joystick image 362 is moved in coordination with 
movement of the user object 34, as described above. A spatial texture is graphically designated 
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in the displayed axis by left grating 364 and right grating 366, which represent "bumps" in the 
texture. Left grating 364 has a different size of "bump" and a different spacing between bumps 
than right grating 366. The appropriate texture is felt by the user on user object 34 and 
visualized on representation 360 as the user object is moved through the textured region. The 
user preferably can specify the space between bumps, the size of the bumps, the magnitude of 
the bumps (shown by the height of the grating in representation 360), and the overall size of a 
textured region in an axis. Each axis can preferably be separately characterized with textures. 
An alternative graphical representation of a texture condition is described with reference to 
Figure 24. 

FIGURE 9a illustrates a graphical representation 370 that can be displayed in interface 
300 for a wall condition. Hard-stop images 372 and/or 374 can be provided in the path of travel 
of the joystick image 376. As shown in FIGURE 9b, when the user object is moved to 
encounter the wall force, the joystick image 376 is correspondingly moved as shown by arrow 
378 against the stop image 372. The user can specify the location of the wall, the hardness of 
the wall, and other parameters as discussed above for a wall condition. For example, if the user 
specifies the wall as having a hard like metal material, the image of the joystick 376 will not 
tend to bend or compress the stop image 372. However, if the wall is specified as a flexible, 
rubber-like material, the joystick 376 can be displayed moving into the stop image 372 or the 
stop image can be displayed as '-compressing" or shrinking as the wall "flexes" in response to 
the user object moving into it. 

Other condition force sensations may also be similarly graphically represented in design 
space 306. For example, a damping condition can be displayed similarly to the spring 
condition, where a schematic representation of a damper is displayed in each direction on an 
axis. Another alternative damper representation is shown with respect to Figure 12. An inertia 
condition can be represented using a graphical image of a mass on top of or connected to the 
joystick image 338, where the size of the image indicates the size of the mass. A friction 
condition can be represented by a texture having bumps or the like, or by a region having a 
specific color or shade. 

In other embodiments, a 2 dimensional force sensation (i.e. two degrees of freedom) can 
be displayed in the window 326 by showing an overhead representation of the user object. For 
example, a circular user object image can be displayed in the middle of two sets of spring 
images in a cross formation, each set of springs for a different degree of freedom. 

FIGURE 10 illustrates interface 300 with a graphical representation for a periodic wave 
(effect) sensation. Periodic window 380 is displayed in response to the user selecting (e.g., 

25 



PCT/US98/12389 

WO 98/58308 

double clicking on) periodic icon 382 that has been dragged into design space 306. The 
periodic window 380 includes a waveform source field 384, magnitude scale 386, envelope 
parameters 388, direction dial 390, trigger parameters 392, and a graphical representation 392. 
Waveform source field 384 allows a user to select from multiple available types of s lg nal wave 

5 sources for the effect. In the case of Figure 10, the user has selected a square wave source. 
Graphical representation 394 is displayed having a shape based on the wave source chosen. 
Thus a square wave is graphically displayed in the example of Figure 10. The direction of the 
waveform may also be selected using dial 396 (which is partially obscured by the wave source 
dropdown menu) and field 397. A period 399 may also be input to specify the frequency of 

10 the waveform- 

The magnitude scale 386 can be adjusted by the user to select a magnitude of the wave 
shown by graphical representation 394. In the preferred embodiment, the scale is a slider 
control knob 398 that can be moved by the user along the scale 400, where the scale 400 is 
15 preferably arranged in a vertical orientation corresponding to the magnitude scale of graphical 
representation 394 to permit greater ease of visualization on the part of the user. In other 
embodiments, other magnitude selection fields or objects may be provided. 

Envelope parameters 388 allow the user to shape the waveform into a desired effect. 

20 For example, parameters 388 preferably include a duration field 402, a gain field 404 (where 
"gain" can be used as a global scaling factor or multiplier for force magnitudes output by the 
interface device 14), and attack and fade parameters 406 to permit the specifying of impu se 
magnitude and fade rate. Direction dial 390 is a graphical object allowing a user to specify the 
direction of the effect in two dimensions. The user may drag or otherwise specify the angle of 

25 the pointer, which is also show* in direction field 408 (dial 396 is preferably similar). Tngger 
parameters 392 allow a user to assign trigger button(s) to the designed effect. The repeat 
interval field 410 allows a user to specify the amount of time before the effect is repeated if the 
designated button is held down. These parameters and characteristics can be entered as numbers 
in the displayed input fields or prompts, or can be input by dragging the graphical 
30 representation 394 of the waveform with a cursor to the desired shape or level. 

The parameters, when specified, cause the graphical representation 394 to change 
according to the parameters. Thus, if the user specifies a particular envelope, that envelope is 
immediately displayed in the window 380. The user can thus quickly visually determine how 
35 specified parameters exactly affect the periodic waveform. The user can also aenvate the 
waveform sensation and grasp the user object to experience the actual force sensation. 
Preferably, the graphical representation 380 is animated or a pointer is moved m coordmauon 
with the output of the force sensation on the user object. For example, if an impulse and fade is 
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specified, the wave is animated so that the impulse portion of the waveform is displayed when 
the impulse force is output on the user object, and the fade is displayed when the output force 
fades down to a steady state level. Alternatively, the entire waveform can be displayed, and a 
pointer or other marker can designate which portion of the waveform is currently being output 
as a force on the user object. This feature enables the user to realize how different portions of 
the wave affect the feel sensation on the user object. 

FIGURE 1 1 illustrates interface 300 displaying a graphical representation of an 
advanced periodic sweep sensation. This type of waveform may include additional variables 
and features over the standard waveform effect described with reference to Figure 10. A 
periodic sweep sensation is similar to a standard periodic waveform or vibration, but is different 
in that the direction of the force sweeps between a start and end orientation or direction. A start 
dial 412 and an end dial 414 are used by the user to define the starting and ending directions for 
the periodic sweep. In example of Figure 11, the user has chosen a sine wave as the signal 
source in field 384. The user also has assigned values to the magnitude, period, and of the 
signal, similar to the waveform of Figure 10. The user has also activated the envelope feature 
and has created an impulse wave shape using attack and fade parameters 406. In addition, the 
user can assign a phase using a phase pointer 416 and phase field 418, which indicate the phase 
angle of the waveform. These parameters and characteristics can be entered as numbers in an 
input field or prompt, or can be input by dragging the graphical outline of the waveform with a 
cursor to the desired shape or level. When the user wishes to test the force sensation, the user 
can feel the direction of the force sweep through the directions as specified in the dials 412 and 
414 and can thus easily determine the correlation of the dials and the desired feel sensation. 

Other waves that can be designed and tested in the interface 300 include a "smart pop" 
and a vector force. For example, a Vector force can be designed using a window similar to 
window 380, where the direction of the force is selected with dial 390. An envelope could also 
be specified for the vector force, if desired, using window 390 and displayed therein. 

Dynamic force sensations, when selected in design space 306, are similarly displayed in 
a sensation window and provide parameter fields into which the user may enter parameter data 
A visual representation can be displayed as the simulated physical system described above. For 
example, the Dynamic Control Law sensation has parameters that directly affect the 
components of the displayed physical system and can be readily viewed and tested by the user. 
For the other dynamic sensations, the user can be shown the mapping of the parameters of the 
selected dynamic sensation to the dynamic control law parameters so the user can view how the 
parameters effect the simulated physical system. In other embodiments, a more appropriate 
representation might be displayed instead of or in addition to the physical system described 
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above For example, for the sling and paddle sensations, a representation of the ball and sling 
can be displayed. For Dynamic Liquid, the user object can be displayed in the middle of 
animated liquid which undulates in conjunction with the movement of a simulated mass. For 
Dynamic Recoil, a picture of a gun or weapon can move in conjunction with the blast and 
reverberation of the sensation. Other animations and representations can be provided as 



desired. 



Once a force sensation has been designed using the graphical tools as described above, 
the definition can be saved as a resource of parameters. By accessing the interface resource 
from an application program, the resource is converted automatically from a parameter set to 
code in the desired language or format, e.g., Direct-X by Microsoft® Corporation for use in the 
Windows™ operating system. For example, the force feedback resource can be provided as or 
in a DLL (Dynamic Linked Library) that is linked to an application program. In one 
embodiment, the DLL can provide the application program with effects defined as completed 
Direct_X Structs (DI_Struct), where the application programmer can then create effects by 
using the CreateEffect call within Direct-X (or equivalent calls in other languages/formats). Or, 
the DLL can perform the entire process and create the effect for the application program, 
providing the programmer with a pointer to the sensation. One advantage of using the first 
option of having the programmer call CreateEffect is that it gives the programmer the 
opportunity to access the parameters before creating the effect so that the parameters can be 
modified, if desired. 

FIGURE 12 illustrates interface 300 displaying a graphical representation of a damping 
condition (damper) in design space 306. The user has dragged a damper icon 324 into the 
design space 306. A damper window 450 is displayed in design space 306 when damper icon 
324 is selected. Within damper window 450 are two main windows, one for each axis 
(assuming two axis interface device). The second axis has not been specified in the example of 
Fig 12. Within the first axis window are fields 452 characterizing the damping force, similar to 
fields 328 in spring window 326 of Figure 6. The axis or axes in which the force is applied is 
selected in field 454. If both axes are selected, then a window for each axis is displayed and 
includes a graphical representation of the force sensation. The user can select a global force 
gain using slider 456. A defaults button 461 can be selected by the user to return all parameter 
values to default levels (preferably, the user can save preferred default levels if desired). The 
user can also select both-axes box 458, which causes the parameters of one axis to be 
automatically mimicked for the other axis, i.e., the parameters of one axis are copied to the 
parameters of the other axis. When the parameters of one axis are modified, the parameters of 
the other axis are automatically changed to be the same. The user can select symmetric box 460 
to make each direction on an axis mirror each other, i.e., the parameters in one direction are 
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automatically copied to the other direction on that axis. If both boxes 458 and 460 are selected, 
the user need only edit force sensation parameters for one direction of one axis, and the force in 
all the other directions of all the axes will be characterized the same as the edited direction. 
Thus, boxes 458 and 460 allow easy specification of symmetric forces. 

The main damper window 462 offers two modes: simple and advanced. The simple 
mode is shown in Figure 12. In this mode, a column of represented liquid 464 is shown for the 
negative direction on the first axis, and a column of represented liquid 466 is shown for the 
positive direction on the first axis. The height of each liquid column indicates the magnitude of 
10 damping in that direction, where the height is equivalent to a damping constant b in the 
equation F = bV, where v is the velocity of the damped object and F is the resulting force. 

When testing the feel of the damping force, the user moves the user object, such as a 
joystick, and feels the force sensation in real time. In interface 300, the middle line 468 

15 represents the position of the user object. When the user moves the user object in the negative 
direction represented in window 462, the line 468 moves to the left. To the user, it looks as if 
the line is moving against a large column of water or liquid, and the feel of the user object feels 
the same way. As the line moves left, the column of liquid 464 gets thinner and the column of 
liquid 466 gets wider. In add.tion, liquid preferably is animated on display screen 20 to shoot 

20 out of left pipe 470 as the user moves the line left. This conveys the damping concept to the 
user in a graphical, intuitive way. A similar result occurs if the user moves the line 468 to the 
right, into column 466, except a smaller damping force is felt. 

As described above, the normal procedure for a force designer in using interface 300 is 
25 to input parameters for a selected type of force sensation, test the way the force feels by 
manipulating the user object, adjusting the parameters based on the how the force feels, and 
iteratively repeating the steps of testing the way the force feels and adjusting the parameters 
until the desired force sensation is characterized. Normally, the user would then save the 
resulting parameter set describing this force sensation to a storage medium, such as a hard disk, 
30 CDROM, non-volatile memory, PCMCIA card, tape, or other storage space that is accessible to 
a computer desired to control the force feedback. The user also preferably assigns an identifier 
to the stored parameter set, such as a filename, so that this force sensation can be later accessed. 
Thus, other application programs running on a host computer can access the parameter set by 
this identifier and use the designed force sensation in an application, such as in a game, in a 
35 graphical user interface, in a simulation, etc. 

The icons 451 and 453 are designed to help the user with the design of force sensations 
from previously stored force sensations. Clip objects icon 451, when selected, provides the 

29 



15 



PCT7US98/12389 

WO 98/58308 

user with a list or library of predefined, common force sensations that the user can use as a base 
or starting point, i.e., the user can modify a common spring condition configuration to quickly 
achieve a desired force. This library can be provided, for example, from commercial force 
providers or other sources. Favorites icon 453, when selected, causes a list of force sensations 
5 that the user himself or herself has previously stored on the storage medium and which can also 
be used as a starting point in designing force sensations. 

FIGURE 13 illustrates interface 300 displaying the damping condition as in Figure 12. 
However, in Fig. 13, the user has adjusted the columns of water to change the damping force, 
10 where column 464 has been decreased slightly, and column 466 has been increased by a large 
amount In the preferred embodiment, the user can select a column using a cursor and drag the 
level of the liquid column up or down to adjust the damping force. This, in effect, adjusts the 
damping coefficient b in that direction. The user can also adjust coefficients by directly 
inputting values into fields 452. 

FIGURE 14 illustrates interface 300 displaying the damping condition of Figure 12. 
However in Fig. 14, the user has selected the advanced mode for graphically representing a 
damping 'condition. The user has selected button 472 to select advanced mode. In this mode, 
the columns of liquid 464 and 466 of simple mode are no longer displayed. Instead, a force vs. 
velocity profile 474 for a damping condition is displayed in window 462. The profile 474 
represents all aspects of the damping condition, much of which was not represented in simple 
mode For example, the saturation values are shown as control points 478, deadband is shown 
by control points 480, and coefficients are shown by the slope of lines 482. This representation 
is less intuitive than the simple model and would typically be used for designers have some 
25 expenence in designing damping sensations. As with all the sensations, the user can move the 
user object in directions on the appropriate axis, and line 484 moves as a result based on the 
velocity of the user object, where the user feels the damping sensation provided by the 
displayed profile at the point where line 484 intersects a line 482. The displayed parameters are 
preferably sent to the local microprocessor of the interface device. The local microprocessor 
30 then outputs the specified force while the host computer displays the graphical changes in 
interface 300. ' In alternate embodiments, the host can directly output control signals to 
actuators to control any force sensations as well. 

An inertia icon shown in palette 302 (of Fig. 16, for example) can be selected to 
35 similarly design an inertia condition in a window in design space 306. The inertia force can be 
graphically represented by a force versus acceleration profile, similar to the force versus 
velocity profile displayed for the advanced damping condition. 
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FIGURE 15 illustrates the advanced damping model of Figure 14 after the user has 
adjusted some of the parameters of the damping force sensation. In the preferred embodiment, 
the user may select the control points 478 and 480 and drag them to any desired position. This 
adjusts the saturation, offset and deadband values directly, and also adjusts the coefficients by 
adjusting the slope of lines 482. 

Also in Fig. 15, the user has adjusted the negative direction coefficient to be negative, 
i e a negative slope. This type of control is meant for advanced users, since a negative 
damping force is unstable: it means that the faster the user moves the user object in that 
direction, the stronger will be the damping force urging the user object in that direction, rather 
than resisting the user object. 

FIGURE 16 illustrates interface 300 displaying an alternative graphical representation 
of a spring condition. Fig. 16 also shows the variety of conditions 491 available to be selected 
from the condition list. The representation used in Figure 6 can be used for a spring condition 
as well. In Fig. 16, the user has selected spring icon 490 in the design space 306. A spnng 
condition window 492 is displayed in the design space 306 when icon 490 is selected. As in 
the damping condition window 450 of Figure 12, the spring window 492 includes parameters 
452 for characterizing the spring force, as well as gain 456 and axis control 454. A window is 
displayed for each axis in which the force is to be applied. The greyed out window for the 
second axis condition indicates that no force is presently assigned to that axis. 

In first axis window 494, a simple mode and advanced mode is available, similar to the 
dampine condition. In Fig. 16, simple mode has been selected by the user. Spnng images 496 
are displayed from each edge of window 494, where spring image 496a is for the negative 
direction and spring image 496b is for the positive direction. When the user moves the user 
object along the displayed axis (the x-axis), line 498 moves in the corresponding d^ection. 
When the line 498 moves into a spring image 496, the microprocessor outputs the specified 
spring force on the user object so the user can feel the characterized force sensation. As the 
user object continues to be moved into the spring, the spring image compresses as a real spnng 
would The empty space between spring images 496 indicates the deadband region where no 
forces are output. It should be noted that the user will feel a spring force if any component of 
the user object's motion is along the x-axis; if the user moves the user object at a 45^egree 
angle (where the x-axis is at 0 degrees), then a component of the spring force in the x-axis will 
be felt This component will be a weaker spring force than if the user object were moved 
directly on the x-axis. This is also preferably the case for all the conditions of the interface 300. 
In some alternate embodiments, the spring force might be turned off in all directions except for 
movement precisely (or within a tolerance) of the displayed axis. 
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FIGURE 17 illustrates spring condition window 492 of Fig. 16 after the user has 
adjusted the parameters of the spring force sensation. In the preferred embodiment, the user 
may adjust the stiffness (k) of the spring force by selecting control points 500 at the edges of 
the front of the spring images 496 with a cursor. The user can drag the control points to adjust 
the widths of the spring images, which in turn adjusts the stiffness parameter (where stiffness k 
is a constant in the equation F = kx, x being the displacement of the user object and F being the 
resulting force). A thicker spring image indicates a larger stiffness parameter, and a stronger 
spring force. Thus, image 496a is wide and indicates a large spring force in the negative 
direction, and the opposite in the positive direction. 

The user may also move the front ends of the spring images closer together or further 
apart, thus adjusting the deadband and offset parameters. The current location of the user 
object is indicated by line 498; the dashed line 502 indicates the center position on the 
displayed axis. As parameters are adjusted, they are sent to the local microprocessor which 
then implements the newly characterized force on the user object (if appropriate). 

FIGURE 18 illustrates the advanced mode for the spring condition of Fig. 16. As in the 
damper condition of Figure 14, the advanced spring condition shows a force vs. displacement 
profile in window 494 instead of the spring images 496. AH the parameters for the spring 
condition are graphically represented in window 494, including saturation values as indicated 
by control points 504 (saturation values were not represented in the simple mode of Fig. 16). 
The deadband and offset are defined by control points 506, while the stiflhess is indicated by 
lines 507. This representation is less intuitive than the simple model and would typically be 
used for designers have some experience in designing spring sensations. As with all the 
sensations, the user can move the user object in directions on the appropriate axis, and line 508 
moves based on the displacement of the user object, where the user feels the spring sensation 
provided by the displayed profile when the line 508 intersects the lines 507. The steepness of 
the slope of lines 507 provides an intuitive representation of the amount of spring stifmess 
provided. The displayed parameters are preferably sent to the local microprocessor, which 
outputs the specified force on the user object while the host computer displays the graphical 
changes in interface 300. 

As with the advanced damping model, the control points 504 and 506 may be moved by 
the user by selecting the desired point and dragging it to a new position. This adjusts the 
saturation, offset and deadband values directly, and also adjusts the stifmess by adjusting the 
slope of lines 507. A negative stiffness can also be specified, which is not possible in the 
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simple mode of Figure 16; but a negative stiffness is better represented as a slope with a 
different image as described below with reference to Figure 21 . 

FIGURE 19 illustrates interface 300 displaying active windows for both x- and y-axes 
5 of the interface device. Field 454 is adjusted by the user to display both axes. For the first axis 
(x-axis), displayed in window 494, the user has selected the advanced mode as described in 
Figure 18. For the second axis (y-axis), displayed in window 510, the user has selected the 
simple mode as described in Figure 17. When the user moves the user object, the line 508 
moves simultaneously with line 509 as long as the user object movement has both x- and y 
10 components. If two simple modes are simultaneously displayed in windows 494 and 510, 
spring images in both axes may be compressed simultaneously with the appropriate movement 
of the user object. 

FIGURE 20 illustrates interface 300 displaying the damping condition window 450 of 
15 Fig. 12 simultaneously with spring condition window 492 in design space 306. This may 
indicate that the user is designing a compound force sensation consisting of two different force 
sensations. As shown, the user has designated the x-axis of the user object to have both a 
spring force, represented by spring images 496, as well as a damping force, represented by 
images 464 and 466. The user can test the resulting compound force sensation by moving the 
20 user object along the x-axis. The microprocessor is sent both sets of parameters and 
superimposes one force sensation on the other. Additional force sensations can similarly be 
dragged as icons into design space 306 and opened to windows by selecting the icons, thus 
creating a compound force sensation with many different individual sensations. 

25 FIGURE 21 illustrates interface 300 displaying a graphical representation of a slope 

condition. As shown, the user has selected slope icon 520 from the list of conditions displayed 
in sensation palette 302. The icon 522 is displayed in design space 306, and after the user 
selects icon 522, slope condition window 524 is displayed in design space 306. As in the other 
condition windows, slope condition window includes parameters 452, 454, and 456. A 

30 graphical representation of the slope condition is displayed in window 526. The user has 
selected simple mode in this example, and is only specifying a force in the first axis of the 
interface device (the advanced mode for the slope condition is preferably identical to the 
advanced mode of the spring condition, described above in Figures 18 and 19). 

35 A slope condition is represented as a ball 528 controlled by the user and rolling on a hill 

530. The ball 528 starts in the center of the hill, and as the user moves the user object to the 
right, the ball begins to roll down the hill to the right. A dashed line 529 is displayed through 
the middle of the ball and moves with the ball to indicate the position of the user object. As in 
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rea ,.world equivalent, the ball moves faster the further away (tan, the lop it rolls. A 
^ponding force sensation is output on the user object during Una vrsual representanon, 
the force sensation is provide as a negative spring stiffness. This ts the same type of 
force as provided in the spring condition, except the stiffness k is a negative value. The further 
te nser moves the user object from the flat top area of the hill, the stronger . the force pulhng 
the user away from the top of the hill. This is an unstable type 0 f force, smce further one 
loves the us r object in a direction, tine grealcr .he force in that direction. This type of force . 

modelled by the ban on a hi,, reflation, and allows the user to intu.t.vely premm and 
design forces having a negative stiffness parameter. 

The user may adjust tire parameters of tire slope condition by dragging control points 
provided on tire hill image. Control points 532 control the size of the deadband and the offset 
Ld represented as the size and location oflhe flat top area of ft. hill. Control potnts 534 
: » the stiffness of the slope force, which is tire curvature of the hill. The ocntron where 
Thill changes from a curvy slope to a linear slope (a, points 534) ts the safumtton va.ue, 
which can be adjusted by moving control pomts 534. 

FIGURE 22 illustrates another example of a graphical representation of the slope 
condition. In.hisexamp.e.ur.ome.Uzero.some.opofmchU.isce^.e^^^^ 
of the axis. Both sides of the hill have close to me same curvature, reflectmg drat the srtffhess 
values in positive and negative directions are close to each other rn value. 

FIGURE 23 illustrates a third example of a graphical representation of the slope 
condition. In this example, the user has defined a negative stiffness in tire posrtrve d.recUon 
Z a positive stiffness in tire negative direction. The negative stifnress ts -P^J 
downward slope of a hill, as in the examples of Fig. 21 and 22. The posurve srtflhess ,s 
Rented as an upward slope of a hi... This upward slope is essentially a 
Presenting a spring condition as in Fig. 16, which also is defined by a postttve auflhess. The 
U to nsmg L slope representation as in Fig. 23 over the spring 
, wTSL an axis can be intuitively designed with a positive stifmess rn one duecuon and a 
' Z£2Z in -he other direction, which is no, as easily visualiaed using the aprtng 
graphical representation of Figure 16. 

FIGURE 24 illustrates interface 300 displaying an alternate graphical ^cnUtion of a 
5 texture condition. Either the representation of Fig. 24 or the representation of Fig. 8 may be 
"eadvanugetotherepresenuhon 
displayed in a single window or area. 



34 



10 



15 



PCT/US98/12389 

WO 98/58308 

,„ Fig. 24, the user has selec,=d a texture condition icon 540 from sensation palcne 302. 
The JL icon 42 has been dragged inio desi^, space 306 and has heen selected, resuiun tn 
^"n Won window 544 betog displayed in the design space 306. Tamo condmo 
w"cludes a styie parameter 546 which is simiiar to the axis f,e,d 454 of the damper and 
'Z condttion windows, allowing the user to seiec, which axes the texture ts to be prov d^ 
rZrleter 548 is a giobal scaling factor for force magmtudes to, for example, adjust force 
:Z i: Ir dtffcrc!, hardware. Spacing parser 550 defines ,he spacing ebveen 
2w of fine .exmre. Since both x-axis and y-axis are ae.ec.ed ,n wmdow 544, ,he 
ZJZtlLn** «0 applies to bom axes. Different spaong can be apphed .0 each ax, by 
"ally se.ec.ing an ax.s in f,e.d 546 specifying me spacing for mat ax,s, se.ec.mg fit 
other axis in field 546, and specifying the spacing in mat ax,s. Densny param ter 552 
de ITnes me widfi. or fi.ic.mess of.be bumps of fine texture. When both axes are aeleced , 
MdT,he width in both axes is me same. The density for mdividua, axes can be specfied 
,,,,v',o the spacing parameter 550. The roughness sliders allow <he user .0 spectfy a 
n Poa™nega,,vc d..=cuo„ on the axes specified by the a,y,e parame^ 
Hughjs indicates the intensity of fine texture; for cases where .exbure ,s sunulated by 
intemuttent damping, .. is the coefficen. for damping in the bump regmns. 

Window 554 displays a graphical representation of me .exiurc defined by parmemn. 
and shows a user .0 adjus, the parameters graphically. The rexturc is delayed as a fie d of 
Wangles 555 or squares, where the space between fine rectangles is the spacmg parameter «.d 
ZTJL rectlglcs shows me density. Corner lines 55, divide me 
Idnnu, representing the worlcspace of.be user object. The in.™ of center fines 7 
Mcatea he current posifion of me user objec,. Thus, when me user moves me user objec, ,n 
hetTaxcs te imlcfion moves accordingly. When .he in.ersec.ion moves over a rectangle 
^"rtprccessor outputs a bump forces in accordance with .he specified P ~ 
Who. me in.crsec.ion is beiwecn recraj.g.es 555, no force is output. In an — 
l^men, fine posifion of .he user objec. can be indicated by a do, circle or other graph,ca, 
object, which can move in accordance with the user object. 

5 Axis check boxes 560 allow the user to select which ,uadtan.s (or directions) on (he 

„ es m provided with the specific .exmre. .f a box 560 is Cached fine 
q „adran, on ma. ax, is provided with .he texbare; if fine box is ~£ 
ladran. is no. pmvided wifi, fite ,exture. The graph.cal rcprcsenUUon 554 ,s updamd 

, a^ng,". For example, if .he left box 560 is uncheCed, fine left half of fine «p* . 

' Zr'i is greyed ou, or shown as a solid color, indicafing a Tach oHexmrn. No,e ^ 
example, if .he user objec, is fashioned in the right half of d.splay 554 and the loft half of fine 
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display has no texture, the texture force is still output when the user object is moved to the left 
as long as the user object is positioned in the quadrant to the right of the center hne 557. 

If the user selects only a single axis in which to apply a texture using style parameter 
546 the window 554 preferably displays lines, instead of squares, oriented perpendicularly to 
the selected axis, where the lines have a thickness equal to the density parameter and are spaced 
apart a distance equal to the spacing parameter. 

The user can preferably graphical adjust the specified texture by selecting the spacing 
control point 562 and/or the density control point 564 with a cursor and dragging the selected 
control point in certain directions. For example, spacing control point 562 can be dragged to 
the left to decrease the spacing on the x-axis and y-axis, and can be dragged to the right for the 
opposite effect on the x- and y-axes. The density control point can similarly affect the density 
of the texture, as in field 552. Alternatively, four control points can be provided, where two of 
the control points control the spacing and density on one axis (or in one direction), and the 
other two of the control points control the spacing and density on the other axis (or direction). 

FIGURE 25 illustrates interface 300 displaying an angle spring condition. The user has 
selected the angle spring icon 580 from the sensation palette 302 and has selected the icon 582 
in the design space 306 to cause angle spring window 584 to be displayed. An angle spring 
condition is similar to a spring condition as shown in Figure 16, except that a direction of the 
spring force can be specified. In window 584, a direction dial 586 is provided to allow the user 
to specify a direction. The user may either select and drag the pointer 588 of the dial 
graphically to select an angle, or input an angle directly in field 590. Preferably, an angle 
spring always is defined in terms of 2 axes (or more), since the angle is defined within two 
degrees of freedom. 

Window 594 displays the graphical representation of the angle spring. The axis (degree 
of freedom) represented in window 594 is the axis along the specified angle. The user moves 
the user object and dashed hne 592 moves within spring window 594, similar to the 
embodiment of Fig. 16. Only the component of motion of the user object in the specified 
direction is displayed as line 592 moving. The full spring force indicated graphically by 
springs 596 will only be output on the user object if the user moves the user object in the 
direction specified by dial 588 and field 590. If the user moves the user object m other 
directions only a component of the full force will be felt by the user, i.e., if the user moves 
along the x-axis (0 degrees) and a 30 degree spring force is specified, the user will feel a weaker 
spring force than if moving along the 30^iegTee direction. 
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Preferably, the other angle forces shown in palette 302, such as angle barrier 592, angle 
slope 594, and angle wall 596, have direction specification and output similar to the angle 
spring described above. 

5 Other conditions are also listed in palette 302. The wall is a condition that provides an 

obstruction force to the movement of the user object, as discussed above with respect to Figures 
9a and 9b. The location of the wall in provided axes in represented graphically by a large 
shaded line or block on an axis into which the user object is obstructed from penetrating. A 
barrier is similar to a wall, except the user object can penetrate the barrier and pop through to 

10 the other side of the barrier, and thus includes a thickness parameter which can be displayed 
graphically as a thickness of a block. The "spring at current" and "slope at current" conditions 
provide forces that are initiated at a current position of the user object; thus, a spring at current 
force will have an origin centered at the current location of the user object. This is useful for 
designing condition forces centered at other positions of the user object other that its origin 

15 position. 

FIGURE 26 illustrates interface 300 displaying another embodiment of a graphical 
representation of a wave or effect periodic force sensation. The user has selected a periodic 
effect icon 600 in palette 302, and has selected the icon 602 in design space 306 to display the 
20 periodic window 604. Periodic window 604 is similar to the periodic graphical representations 
of Figure 10 and 1 1, described above. In window 604, the user is allowed to select the duration 
of the periodic wave using sliders 606, and may also select an infinite duration with box 608. 
The gain and offset may be selected using sliders 610, and other parameters are provided in 
fields 612. A graphical representation of the periodic waveform is shown in window 614. The 
25 parameters in fields 612 can be graphically adjusted by the user by dragging control points 616 
of the waveform, as described with reference to Fig. 11. A frequency of the waveform can be 
adjusted by dragging a displayed wave to widen or narrow the displayed oscillations of the 
wave Trigger buttons for the periodic wave can be determined in fields 618, and the d.rection 
of the periodic wave in the user object workspace is determined using dial 620 and field 622. 

30 

To test the specified periodic wave, the user preferably selects start button 624, which 
instructs the microprocessor to output the specified force sensation over time to the user object 
so the user can feel it. In the preferred embodiment, a graphical marker, such as a vertical line 
or pointer, scrolls across the display window 614 from left to right indicating the present 
35 portion or point on the waveform currently being output. Since graphical display ,s handed by 
the host computer and force wave generation is (in one embodiment) handled by a local 
microprocessor, the host display of the marker needs to be synchronized with the 
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microprocessor force generate at the start of the force output. The user can stop the output of 
the periodic sensation by selecting the stop button 626. 

While this invention has been described in terms of several preferred embodiments, it is 
contemplated that alterations, permutations and equivalents thereof will become apparent to 
those skilled in the art upon a reading of the specification and study of the drawings. For 
example many different parameters can be associated with dynamic sensations, conditions, and 
effects to allow ease of specifying a particular force sensation. These parameters can be 
presented in the graphical interface of the present invention. Many types of different visual 
metaphors can be displayed in the interface tool of the present invention to allow a programmer 
to easily visualize chanees to a force sensation and to enhance the characterization of the force 
sensation Furthermore, certain terminology has been used for the purposes of descriptive 
clarity and not to limit the present invention. It is therefore intended that the following 
appended claims include all such alterations, permutations, and equivalents as fall withm the 
true spirit and scope of the present invention. 

What is claimed is: 
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1. A method for implementing a force sensation design interface, said method 
comprising: 

displaying said force sensation design interface on a display device of a host computer, 

receiving input from a user to said force sensation design interface, said input selecting 
a type of force sensation to be commanded by said host computer and output by a force 
feedback interface device, said force feedback interface device including a user mampulatable 
object graspable by a user and moveable in a degree of freedom; 

receivmg input from a user defining physical characteristics of said selected force 
sensation; 

displaying a graphical representation of said selected force sensation as characterized by 
said user, wherein said graphical representation provides said user with a visual demonstration 
of a feel of said characterized force sensation; and 

commanding said characterized force sensation to said force feedback interface device 
coupled to said host computer such that actuators of said force feedback interface device output 
said force sensation on said user object in conjunction with said visual demonstrate of satd 
feel of said characterized force sensation. 

receiving additional changes to said characterized force sensation from said user after 
said force sensation is output and displaying said additional changes in said graphical 
representation, wherein a force sensation modified in accordance with said additional changes 
is output by said actuators on said user object 



2 A method as recited in claim 1 further comprising storing a plurality of parameters 
characterizing said force sensation to a storage medium accessible to said host computer. 

3 A method as recited in claim 2 further comprising accessing said stored plurality of 
parameters from an application program different than said design interface, said application 
program using said plurality of parameters to output said characterized force sensahon dunng 
execution of said application program. 
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4. A method as recited in claim 3 wherein said application program is a game program. 

5 A method as recited in claim 1 wherein a local microprocessor, included in said force 
feedback interface device and separate from said host computer, receives a command from said 
host computer to control said actuators to output said characterized force sensation. 

6 A method as recited in claim 1 wherein a plurality of force sensations are selectable 
by said user, and wherein said selectable force sensations include conditions, effects, and 
dynamics. 

7 A method as recited in claim 1 wherein said user may select an advanced mode or a 
simple mode of graphically representing said force sensation in said force sensation design 
interface. 

8 A method as recited in claim 5 wherein in said advanced mode, a force versus user 
object motion profile is displayed, wherein said user may adjust parameters of said selected 
force sensation by dragging displayed control points of said profile. 

9 A method as recited in claim 1 wherein said user may characterize said force 
sensation independently in different directions of a degree of freedom of said interface device. 

10 A method as recited in claim 1 wherein said selected force sensation is a damping 
condition, and wherein said graphical representation includes an image of a column of liquid 
into which said user may move a controlled graphical object by moving said user object such 
that said user feels said characterized damping force sensation. 

11 A method as recited in claim 1 wherein said selected force sensation is a spring 
condition, and wherein said graphical representation is an image of said user manipulatable 
object and an image of a spring, wherein said user may adjust a thickness of said spring to 
adjust a stifmess of said spring condition. 

12 A method as recited in claim 1 wherein said selected force sensation is a slope 
condition, and wherein said graphical representation includes an image of a hill on which a 
graphical object is positioned, wherein a position of said graphical object is controlled by a 
position of said user object, such that a force having a stifmess is applied to said user object 
when said graphical object is moved across said hill. 

13. A method as recited in claim 10 wherein said graphical object controlled by said 
user object is a ball that may be rolled across said hill. 
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14 A method as recited in claim 11 wherein said stiffness of said force is negative 
when sa.d hill has a downward slope, and wherein said stiffness is positive when said hill has 
an upward slope. 

15 A method as recited in claim 1 wherein said selected force sensation is a texture 
condition, and wherein said graphical representation includes images of a plurality of bumps 
representing a spacing and density of said texture. 

16 A method as recited in claim 13 wherein a spacing an d density of said bumps can 
be adjusted by said user by dragging at least one control point displayed in said design 
interface. 

17 A method as recited in claim 1 wherein said selected force sensation is a periodic 
force sensation, and wherein said graphical representation is an image of a periodic waveform. 

18 A method as recited in claim 15 wherein said characterization includes specifying 
an envelope for said periodic waveform, said envelope being displayed in said graphical 
representation. 

19 A method as recited in claim 1 further comprising displaying a graphical 
representation of a second force sensation selected and characterized by said user, wherein both 
said selected force sensations are commanded to be simultaneously output on sa.d user object. 



20. A method for implementing a force sensation design interface for designing a slope 
condition, the method comprising: 

displaying said force sensation design interface on a display device of a host computer, 
said force sensation design interface including a graphical representation of a slope cond.Uon; 

receiving input from a user to said force sensation design interface, said input defining 
physical characteristics of said slope condition to be commanded by said host computer and 
output by a force feedback interface device, said force feedback interface device including a 
user manipulatable object graspable by a user and moveable in a degree of freedom; 

adjusting said graphical representation of said slope condition in accordance with said 
input from said user, 

receiving input from said force feedback interface device indicating said user is moving 
said user object, and commanding said characterized slope condition to said force feedback 
interface device such that actuators of said force feedback interface device output forces of sard 
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slope condition on said user object in conjunction with updating said graphical representation to 
reflect a current position of said user object, said graphical representation providing said user 
with a visual demonstration of a feel of said characterized slope condition. 

21. A method as recited in claim 20 wherein said graphical representation of said slope 
condition includes an image of a hill and a graphical object positioned on said hill, wherein a 
position of said graphical object corresponds to a position of said user object. 

22. A method as recited in claim 21 wherein said graphical object is a ball that may be 
rolled up or down said hill. 

23. A method as recited in claim 21 wherein said forces of said slope condition have a 
negative stiffness, wherein a side of said hill corresponding to said negative stiffness has a 
downward curvature. 

24. A method as recited in claim 23 wherein the further said ball is moved down said 
side of said hill, the greater the force pushing said user object away fiom a center position of 
said user object. 

25. A method as recited in claim 21 wherein said forces of said slope condition have a 
positive stiffness, wherein a side of said hill corresponding to said positive stiffness has an 
upward curvature. 

26. A method as recited in claim 25 wherein the further said ball is moved up said side 
of said hill, the greater the force pushing said user object toward a center position of said user 
object. 

27. A method as recited in claim 22 wherein one side of said hill has a downward slope 
indicating a force with a negative stiffness in one direction, and wherein the other side of said 
hill has an upward slope indicating a force with a positive stiffness in the other direction. 



28. A system for allowing a user to intuitively design spatially varying force feedback 
sensations, said system comprising: 

a host computer system displaying a force feedback design interface on a display device, 
said force feedback design interface displaying a graphical representation of a force sensation 
selected by a user, wherein said user can adjust characteristics of said selected force sensation 
by inputting information to said design interface, said characteristics including stiffness, 
deadband and offset parameters; 
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a force feedback interface device coupled to said host computer system, sa.d force 
feedback interface device receiving said stiffness, deadband and offset parameters and 
C*n g said selected force sensation on a user object of said interface device when 
olanded by said host computer system, wherein said interface device outputs a moaned 
force sensation on said user object corresponding to adjustments to said force sensation made 
by said user; and 

saving said stiffness, deadband, and offset parameters to a storage medium accessible by 
said host computer system, said parameters being provided with an identifier to identify sad 
parameters as a set defining a particular force sensation. 

29 A system as recited in claim 28 wherein said force feedback interface device 
includes a microprocessor separate from said host computer system said micropro cesser 
receivng commands from said host computer system, reading sensors of said interface devrce 
and reporting positions of said user object to said host computer, and commanding actuators of 
said interface device to output said force sensation on said user object. 



30 An apparatus providing a force sensation design interface for designing a force 
sensation to be output to a force feedback interface device, the apparatus compnsmg: 

means for displaying said force sensation design interface on a display device of a host 
computer, said force sensation design interface including a graphical representation of a force 
sensation; 

n«» for receiving inpu. from a user ro said foree sensation design interface, said inpu. 
defining physrcal charac.eris.ies of said force section .0 be commanded by sard bos. 

L;«r and ou<pu, by a force feedback inrcrface device, aaid force feedback 
Ling a user manipulate objec. graspable by a user and moveable » a degree of freedom, 

mM ns for adjusting said graphical represemation of said force sensation in accordance 
with said input from said user; and 

m eans for receiving input from said force feedback interface device indicating said user 
is moving said user object, and commanding said characterized force sensation to said force 
f elck interface device such that actuators of said force feedback interface evrce ou^s* 
force sensation on said user object in conjunction with updating said graphical 
reflect a current position of said user object, said graphical representation proving said user 
with a visual demonstration of a feel of said characterized force sensation. 
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means for writing 
a storage medium. 



infi data describing said physical characteristics of said force sensation to 



3 1 A computer readable medium including program instructions for providing a force 
5 sensation design interface implemented by a computer, said program instructions performing 
steps comprising: 

displaying a design interface on a display device of a computer; 

receiving input in said design interface from a user, said input selecting a type of force 
sensation to be commanded by a host computer and output by a force feedback interface dev.ce, 
10 sTforce feedback interface device including a user manipulate object grabble by a user 
and moveable in a degree of freedom; 

receiving input from a user to specify parameters which define characteristics of said 
selected force sensation; 

displaying a graphical representation of said characterized force sensation in said design 
,5 interface, wherein said graphicai representation inciudes visua, represents of sa 

commanding said characterized force sensation to said force feedback interface device 
co^ed to said host computer such rha, abators of said force feedback interface dev.ce £t£ 
said force sensation on said user object in conjunction with a vrsua, demotion of sard fee. 
20 of said characterized force sensation. 

32 A computer readable medium as recited in claim 31 including program instntctions 
for writing said parameters to a storage medium, said parameters being accessible to apphcatton 
programs implemented on said computer and controlling force feedback. 

33 A computer readable medium as recited in claim 32 deluding program instrucUons 
25 for updating said graphical representation in accordance with said force sensation bug output 

on said user object. 

34 A computer readable medium as recited in claim 32 wherein said visual 
demonsfration includes moving a graphical object in correspondence wilh satd ^ 
wherein when said force sensation is output on said user object, said graphical object engages 

30 an image of said representation. 
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35 A comparer readable medium as recited in claim 34 wherein raid ,mage of satd 
representation includes an image of a spring displayed for a spring force aensauon. 

36 A comparer readable medium aa recired in claim 34 wherein said image of said 
represents includes an image of a column of liquid delayed for a damptng force sensanon. 
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